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METHODS AND APPARATUSES FOR 
PRESENTING CONTENT 

5 

FIELD OF INVENTION 

The present invention relates generally to organizing content and, more 
particularly, to prefetching content. 

10 

BACKGROUND 

With the proliferation of computer networks, in particular the Internet, there 
are an increasing number of commercially available audio/visual content items 
directed for use by individual users. Further, there are a variety of ways to create 

15 audio/visual content items through video cameras, still cameras, audio recorders, 
and the like. There are also many applications available to modify and/or 
customize audio/visual content. 

Individual users have a large number of audio/visual content items 
available to view, modify, and/or create. With a large number of audio/visual 

20 content items available to the user, however, there may be difficulties in finding a 
specific audio/visual content item and accessing audio/visual content items in a 
timely manner. For example, finding a particular audio/visual content is often a 
challenge when the user has access to numerous audio/visual content items. 
Assuming that the desired audio/visual content is found, making the desired 
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audio/visual content available to the user while minimizing lag time for the user is 
also a challenge. 

There is a need to organize and present these numerous pieces of 
audio/visual content items in a more efficient manner to individual users. 
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SUMMARY 

Methods and apparatuses are described for organizing audio/visual 
content and prefetching selected audio/visual content items configured to be 
5 displayed to a user. In one embodiment, the methods and apparatuses for 
presenting content identifies a preference corresponding to a user; detects a 
current display window; and prefetches at least one audio/visual content in 
response, in part, to the current display window and the preference. 
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BRIEF DESCRIPTION OF DRAWINGS 

The accompanying drawings, which are incorporated in and constitute a 
part of this specification, illustrate and explain embodiments of the methods and 
5 apparatuses for presenting content. In the drawings, 

Figure 1 is a diagram illustrating an environment within which the methods 
and apparatuses for presenting content are implemented. 

Figure 2 is a simplified block diagram illustrating one embodiment in which 
the methods and apparatuses for presenting content are implemented. 
10 Figure 3 is a simplified block diagram illustrating an exemplary 

architecture of the methods and apparatuses for presenting content. 

Figure 4 is a simplified block diagram illustrating an exemplary 
embodiment of classes in which the methods and apparatuses for presenting 
content are implemented. 
15 Figure 5 is a simplified block diagram illustrating an exemplary media 

container system of the methods and apparatuses for presenting content. 

Figure 6 is a diagrammatic view illustrating a media display representing 
display windows and genre categories. 

Figure 7 is a flow diagram illustrating a prefetching process, consistent 
20 with one embodiment of the methods and apparatuses for presenting content. 

Figure 8 is a second flow diagram illustrating a prefetching process, 
consistent with one embodiment of the methods and apparatuses for presenting 
content. 
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DETAILED DESCRIPTION 

The following detailed description of the methods and apparatuses for 
presenting content refers to the accompanying drawings. The detailed 
5 description illustrates embodiments of the methods and apparatuses for 
presenting content and is not intended to construct limitations. Instead, the 
scope of the invention is defined by the claims. 

Those skilled in the art will recognize that many other implementations are 
possible and are consistent with the methods and apparatuses for presenting 
10 content. 

References to "content" includes data such as audio, video, text, graphics, 
and the like, that are embodied in digital or analog electronic form. References 
to "applications" includes user data processing programs for tasks such as word 
processing, audio output or editing, video output or editing, digital still photograph 

15 viewing or editing, and the like, that are embodied in hardware and/or software. 

Figure 1 is a diagram illustrating an environment within which the methods 
and apparatuses for presenting content are implemented. The environment 
includes an electronic device 110 (e.g., a computing platform configured to act as 
a client device, such as a personal computer, a personal digital assistant, a 

20 cellular telephone, a paging device), a user interface 115, a network 120 (e.g., a 
local area network, a home network, the Internet), and a server 130 (e.g., a 
computing platform configured to act as a server). 
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In some embodiments, one or more user interface 1 15 components are 
made integral with the electronic device 110 (e.g., keypad and video display 
screen input and output interfaces in the same housing as personal digital 
assistant electronics (e.g., as in a Clie® manufactured by Sony Corporation). In 
5 other embodiments, one or more user interface 115 components (e.g., a 

keyboard, a pointing device (mouse, trackball, etc.), a microphone, a speaker, a 
display, a camera) are physically separate from, and are conventionally coupled 
to, electronic device 110. The user uses interface 1 15 to access and control 
content and applications stored in electronic device 110, server 130, or a remote 

10 storage device (not shown) coupled via network 120. 

In accordance with the invention, embodiments of presenting content as 
described below are executed by an electronic processor in electronic device 
1 10, in server 130, or by processors in electronic device 110 and in server 130 
acting together. Server 130 is illustrated in Figure 1 as being a single computing 

15 platform, but in other instances are two or more interconnected computing 
platforms that act as a server. 

Figure 2 is a simplified diagram illustrating an exemplary architecture in 
which the methods and apparatuses for presenting content are implemented. 
The exemplary architecture includes a plurality of electronic devices 110, server 

20 130, and network 120 connecting electronic devices 1 10 to server 130 and each 
electronic device 1 10 to each other. The plurality of electronic devices 1 10 are 
each configured to include a computer-readable medium 209, such as random 
access memory, coupled to an electronic processor 208. Processor 208 
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executes program instructions stored in the computer-readable medium 209. A 
unique user operates each electronic device 1 10 via an interface 1 15 as 
described with reference to Figure 1. 

Server 130 includes a processor 21 1 coupled to a computer-readable 
5 medium 212. In one embodiment, the server 130 is coupled to one or more 
additional external or internal devices, such as, without limitation, a secondary 
data storage element, such as database 240. 

In one instance, processors 208 and 21 1 are manufactured by Intel 
Corporation, of Santa Clara, California. In other instances, other 
10 microprocessors are used. 

One or more user applications are stored in media 209, in medium 212, or 
a single user application is stored in part in one media 209 and in part in medium 
212. In one instance a stored user application, regardless of storage location, is 
made customizable based on presenting content as determined using 
15 embodiments described below. 

The plurality of client devices 110 and the server 130 include instructions 
for a customized application for presenting content. In one embodiment, the 
plurality of computer-readable media 209 and 212 contain, in part, the 
customized application. Additionally, the plurality of client devices 1 10 and the 
20 server 130 are configured to receive and transmit electronic messages for use 
with the customized application. Similarly, the network 120 is configured to 
transmit electronic messages for use with the customized application. 
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Figure 3 is a simplified diagram illustrating an exemplary architecture of a 
system 300. In one embodiment, the system 300 includes applications 310, a 
5 presentation layer 320, an audio/visual services module 330, a non-audio/visual 
services module 340, a protocol translation layer 350, a universal plug and play 
(e.g. UPnP) network 360, and a non-universal plug and play network 370. 
Overall, the system 300 is configured to allow the applications 310 to seamlessly 
interface through the network 360 and the network 370. 

10 In some embodiments, the applications 310 are utilized by a user. In one 

embodiment, the user is a content developer who creates and/or modifies 
content for viewing by others. In another embodiment, the user is a content 
viewer who consumes the available content by accessing the content. In some 
embodiments, the applications 310 include a prefetch buffer 315 for storing 

15 content that is prefetched for use by the content viewer and/or the content 
developer. 

In some embodiments, the presentation layer 320 processes the content 
information in a suitable format for use by the applications 310. In one instance, 
the presentation layer 320 takes into account the preferences and use patterns of 
20 the particular user. In one embodiment, audio/visual content is pre-sorted 

according the use patterns of the user. In another embodiment, the audio/visual 
content is pre-fetched according to the use patterns of the user. 
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In one embodiment, the presentation layer 320 is configured as a shared 
library. By utilizing the shared library, the application code is condensed into a 
smaller size, because multiple applications 310 utilize the same shared library for 
various commands and instructions. 
5 In some embodiments, the audio/visual service module 330 stores and 

maintains a representation of device information for devices that correspond to 
audio/visual services. In one example, audio/visual services include media 
classifications such as music, videos, photos, graphics, text, documents, and the 
like. In another example, the audio/visual service module 330 is also configured 
10 to store and maintain listings or indices of the audio/visual content that are stored 
in a remote location. 

In one embodiment, the storage locations for the audio/visual content is 
organized according to the use patterns of the particular user. For example, 
audio/visual content that is utilized more frequently is stored in locations more 
15 quickly accessible to the system 300. 

In one embodiment, the non-audio/visual service module 340 stores and 
maintains a representation of device information for devices that correspond to 
non-audio/visual services. Non-audio/visual services includes printing services, 
faxing services, and the like. In another embodiment, the non-audio/visual 
20 service module 340 also stores and maintains listings or indices of the non- 
audio/visual content that are stored in a remote location. 

In some embodiments, the protocol translation layer 350 translates at 
least one underlying protocol into a common application programming interface 
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suitable for use by the applications 310, the presentation layer 320, the 
audio/visual service module 330, and/or the non-audio/visual service module 
340. For example, the protocol translation layer 350 translates the UPnP 
protocol from the UPnP network 360 into the common application programming 
5 interface. In one embodiment, the protocol translation layer 350 handles the 
translation of a plurality of protocols into the common application programming 
interface. 

In some embodiments, the protocol translation layer 350 supports more 
than one network protocol. For example, the protocol translation layer 350 is 
10 capable of storing more than one translation modules for translating commands 
in another protocol into the common application programming interface. 

In other embodiments, the protocol translation layer 350 retrieves an 
appropriate translation module in response to the protocol to be translated. For 
example, the appropriate translation module resides in a remote location outside 
15 the system 300 and is retrieved by the protocol translation layer 350. 

In one embodiment, the translation modules are stored within the protocol 
translation layer 350. In another embodiment, the translations modules are 
stored in a remote location outside the system 300. 

In one embodiment, the UPnP network 360 is configured to utilize a 
20 protocol established by UPnP. 

In one embodiment, the non-UPnP network 370 is configured to utilize a 
protocol established outside of UPnP. For example, Samba and Server 
Message Block are protocols which are not related to UPnP. 
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In one embodiment, the system 300 is shown with the applications 310 
logically connected to the presentation layer 320; the presentation layer 320 
logically connected to the audio/visual services module 330 and the non- 
audio/visual services module 340; modules 330 and 340 connected to module 
5 350; and the protocol translation layer 350 logically connected to the UPnP 
network 360 and the non-UPnP network 370. 

The distinction between the UPnP network 360 and the non-UPnP network 
370 is shown as one possible example for the method and apparatus for 
presenting content. Similarly, the distinction between the audio/visual services 
10 module 330 and the non-audio/visual services module 340 is shown as one 
possible example for the method and apparatus for presenting content. 

Figure 4 is a simplified block diagram illustrating exemplary services, 
devices, and content organized into classes. In one embodiment, these classes 
are utilized by the system 300 to encapsulate and categorize information 
15 corresponding to unique content, devices, or network services relating to the 
presentation layer 320. 

In one embodiment, the classes include both device classes and content 
classes. The device classes allow devices across heterogeneous networks to be 
managed and display of information regarding the devices. The content classes 
20 are configured to manage the audio/visual content, pre-fetch audio/visual 
content, and organize the audio/visual content based on user patterns. 
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Device classes include a device access class 410 and a user device class 
420. Content classes include a content access class 430, a media container 
class 440, and content item class 450. 

There are a variety of commands the group devices within the device 
5 access class 410. In one embodiment, the device access class 410 devices are 
grouped using a GetDeviceList command that retrieves a list of devices across at 
least one network protocol. This list of devices can be further filtered and 
searched based on the device type and the content type. For example, device 
types include audio display, video display, audio capture, video capture, audio 
10 effects, video effects, and the like. In one embodiment, content types include 
documents, videos, music, photo albums, and the like. 

In one embodiment, the device access class 410 devices are grouped 
using a SetDeviceFinderCallback command that establishes a callback function 
when the GetDeviceList command is completed. The SetDeviceFinderCallback 
15 command can also be utilized to discover a device asynchronously. 

In one embodiment, the device access class 410 devices are grouped 
using a GetDefaultDevice command that initializes a specific device as a default 
for a particular device type or content type. In one embodiment, there can be 
more than one default device for each type of content or device. 
20 In one embodiment, the device access class 410 devices are organized 

using a Hide/ShowDevice command that either removes a device from view or 
exposes hidden devices. 
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In one embodiment, the device access class 410 devices are organized 
using a SortDevice command that sorts devices based on alphabetical order, 
device type, supported content type, and the like. 

In one embodiment, the user device class 420 devices are grouped using 
5 a GetDeviceByName command that searches the entire network for a specific 
device. In one embodiment, the specific device is identified through a device 
identifier that is unique to each device, such as a device serial number. In 
another embodiment, the specific device is identified through a name associated 
with the device. 

10 The content access class 430 assists in facilitating searches, discovery, 

and organization of content. In one embodiment, the content access class 430 
content is grouped using a PrefetchContentList command that builds a content 
list based on preference information corresponding to a particular user. In one 
embodiment, the preference information is stored within the system 300. For 

15 example, the PrefetchContentList command is initiated when a particular user is 
identified. In another embodiment, the PrefetchContentList command us initiated 
and updated during a session with the same user. In some embodiments, 
prefetching content is performed based on the preferences stored within the 
content list. 

20 In one embodiment, the content access class 430 content is grouped 

using a GetContentList command that returns a content list of content items. For 
example, these content items are located at addresses in multiple networks and 
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are stored in numerous different storage devices. In one instance, these content 
items each come from different storage devices such as media containers. 

In one embodiment, the content list is obtained in multiple segments. In 
another embodiment, the content list is obtained in a single segment. In one 
5 embodiment, the content list includes a reference to the location of the content 
and/or additional details describing the device that stores the content. 

In one embodiment, the content access class 430 content is grouped 
using a GetContentByGenre command that retrieves content items according to 
a specific content genre. For example, in some instances the content items 
10 within the requested genre are located in multiple media containers. 

In one embodiment, the content access class 430 content is grouped 
using a GetMediaContainers command that retrieves specified media containers 
based on a search criteria and the content within the media containers. For 
example, each media container is defined by a genre type or an artist. If the 
15 genre is specified, the media containers that are associated with this specified 
genre are identified. Further, the individual content items are also specifically 
identified if they are within the specified genre. 

In one embodiment, the content access class 430 content is grouped 
using a GetDefaultGenre command which initializes specific genre as a default 
20 for a particular user. For example, content items which match the specific genre 
are highlighted on the content list and are prefetched from their respective media 
containers in response to the particular user. 
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The media container class 440 provides tools for managing content lists in 
class 430. In one instance, these content lists are managed by the media 
containers. In one embodiment, the media container class 440 groups media 
containers by a GetMediaContainerlD command which allows all media 
5 containers to be referenced by a unique media container identification. This 
command provides the unique identification to each media container. 

In one embodiment, the media container class 440 groups media 
containers by a GetMediaContainerName command which, in turn, allows the 
media container to be referenced by a descriptive name. For example, a 
10 descriptive name includes "family room music", "home videos", and the like. 

The content class 450 provides tools for representing individual content 
items. In one embodiment, individual content items are represented in content 
lists. In one embodiment, the content class 450 content items are grouped using 
a GetContentID command that allows all individual content items to be 
15 referenced by a unique media content identification. This command provides the 
unique identification to each individual content item. 

In one embodiment, the content class 450 content are grouped using a 
GetContentTitle command that returns the title of the individual content items. 
Figure 5 is a simplified block diagram illustrating an exemplary media 
20 container system 500. In one embodiment, a media container stores content. In 
another embodiment, a media container stores a list representing content. In 
one embodiment, the media container system 500 includes a root media 
container 510, a thriller media container 520, an easy media container 530, a 
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classical media container 540, and a folk media container 550. In some 
embodiments, the media containers allow audio/visual content to be prefetched 
and available for a user. 

In one embodiment, the media containers 510, 520, 530, and 540 are 
5 similar to folders on a conventional computer system and are configured to link to 
other media containers and/or provide a representation of audio/visual content. 

For example, the root media container 510 is logically connected to the 
thriller media container 520, the easy media container 530, the classical media 
container 540, and the folk media container 550. Each of the media containers 
10 520, 530, 540, and 550 include title lists 525, 535, 545, and 555, respectively. 
Each title list includes a listing representing various audio/visual content. 

Figure 6 is a simplified block diagram illustrating a media display diagram 
600 representing display screens and genre categories. The media display 
diagram 600 includes a plurality of genres 605, 610, 615, and 620; and a plurality 
15 of display windows 625, 630, 635, 640, and 645. Each genre represents content 
that is represented within each of the display windows. 

For example, within the rock music genre 605, many different pieces of 
rock music content are displayed within each of the display windows 625, 630, 
635, 640, and 645. In this example, display window 635 is the current display 
20 window (n window). Similarly, the display window 630 is the n-1 window; the 
display window 625 is the n-2 window; the display window 640 is the n+1 
window; and the display window 645 is the n+2 window, where n represents the 
current display window. 
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In this example, audio/visual content is represented within the display 
windows. In one embodiment, the audio/visual content is represented in list, 
icon, and/or thumbnail form. In some instances, a user selects the audio/visual 
content represented in the display windows. 

To minimize the wait time of utilizing the selected audio/visual content, the 
method and apparatus for presenting content prefetches the audio/visual content 
based, in part, on the location of the particular audio/visual content listing relative 
to the listings displayed in current display window 635. For example, if the 
methods and apparatuses for presenting content are configured to prefetch 
audio/visual content within the current display window 635, then the audio/visual 
content represented within the display windows 625, 630, 640, and 645 are 
prefetched. As the user scrolls through the various display windows, the 
prefetched audio/visual content dynamically changes. In one illustrative 
employment, content items that correspond to each content item listing displayed 
in n+/-1 windows are prefetched, where n=1. In some embodiments, the 
prefetched content represented in the display windows 625, 630, 640, and 645 
are temporarily stored within the prefetched buffer 315. 

In some embodiments, the content represented within the display windows 
625, 630, 640, and 645 is determined through preferences associated with the 
particular user. For example, in some instances, content such as a particular folk 
song is selected for the current display window 635, and content for the display 
windows 625, 630, 640, and 645 is automatically selected based on the user's 
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preferences and the particular folk song that is selected for the current display 
window 635. 

The flow diagrams as depicted in Figures 7 and 8 are exemplary 
embodiments of the methods and apparatuses for presenting content. In each 
5 embodiment, the flow diagrams illustrate various applications corresponding with 
the system 300. 

The blocks within the flow diagram may be performed in a different 
sequence without departing from the spirit of the method and apparatus for 
presenting content. Further, blocks may be deleted, added, or combined without 
10 departing from the spirit of the methods and apparatuses for presenting content. 

Figure 7 is a flow diagram that illustrates prefetching content to provide 
access to content through the system 300. 

In Block 710, the identity of the user is detected. In one embodiment, the 
identity of the user is authenticated through the use of a password, a personal 
15 identification number, a biometric parameter, or the like. 

In Block 720, a preference is loaded corresponding to the user. For 
example, the preference includes parameters such as genre selections, and play 
lists. These parameters are detected through the actions of each user. 
Accordingly, the preference is unique to each particular user in one embodiment. 

20 

In Block 730, audio/visual content is organized. In some embodiments, 
the audio/visual content is grouped and organized according to various classes 
and commands as discussed above with reference to Figure 4. In other 



18 



PATENT 
SONY-05200 

embodiments, the audio/visual content corresponds to the play list and 
preferences associated with the user. For example, in one instance the 
audio/visual content is organized according to the probability of being utilized by 
the user based on the current display window 635 as graphically shown in Figure 
6. 

In Block 740, the current display window is detected. In some 
embodiments, the current display window is represented by content presently 
viewed by the user. In other embodiments, the current display window is 
represented by the content that is selected by the user. 

In Block 750, audio/visual content is prefetched for utilization by the user. 
Based, in part, on the preferences and content representing the current display 
window, a range of audio/visual content is prefetched. For example, the 
audio/visual content that is represented within n windows of the current display 
window may be prefetched. The number n can be any number of windows. 

In another embodiment, a different reference may be utilized to prefetch 
audio/visual content besides display windows. 

Figure 8 is a second flow diagram that illustrates prefetching content to 
provide access to content through the system 300. 

In Block 810, the activity of the user is detected. For example, the 
frequency in which a user scrolls through the display windows, the frequency in 
which the user changes audio/visual content selections, and the frequency in 
which the user selects particular audio/visual content selection are measured. 
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In Block 820, the audio/visual content of interest is identified. In one 
embodiment, the audio/visual content is grouped and organized according to 
various preferences through classes and commands as discussed above with 
reference to Figure 4. In another embodiment, in addition, the media containers 
5 and associated play lists, as discussed above with reference to Figure 5, are 
utilized to identify content associated with the user. For example, the 
audio/visual content is organized according to the probability of being utilized by 
the user as graphically shown in Figure 6. 

In yet another embodiment, services and/or content are searched by 

10 various parameters. Exemplary parameters are found in the description of the 
different classes illustrated in Figure 4. In one embodiment, content is identified 
and filtered through these various parameters including, but not limited to, 
device/service availability, associated protocol, type of service, type of device, 
and the like. In another embodiment, these services and/or devices span more 

15 than one network and utilize more than one protocol to interface with the content. 
In Block 830, parameters are set for the prefetching function. For 
example, parameters for the prefetching function include the range in which the 
audio/visual content is prefetched, the frequency in which prefetching occurs, 
and the sensitivity in responding to user activity. 

20 In one embodiment, the range for prefetching audio/visual content is within 

one display window. In other embodiments, the range for prefetching may be 
within any number of display windows. In some embodiments, the actual range 
of prefetching depends on the user activity detected in the Block 810. In another 
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embodiment, the range for prefetching depends on the size of the content, 
memory considerations, and user history. 

In one embodiment, the frequency of updating the prefetching operation 
depends on detecting new user activity. In another embodiment, the frequency 
5 of updating occurs at a predetermined time interval, such as every 5 minutes. 

In Block 840, the display window is detected. 

In Block 850, audio/visual content is prefetched in response to the 
parameters for the prefetch function and the display window. For example, in 
some instances audio/visual content that is represented in the display window 
10 and within the preset range of the display window as determined by the 
parameters in the Block 830 is prefetched from the stored locations into the 
prefetched buffer 315. In some embodiments, the prefetched audio/visual 
content is available to the user locally within the prefetched buffer 315. By 
having the prefetched audio/visual content local, there is less delay than if the 
15 prefetched audio/visual content had to be transmitted from the original, remote 
location. In some embodiments, as new content is loaded into the prefetched 
buffer 315, old content is removed and replaced by the new content based on 
user preferences, the range, and the current display window. 

In Block 860, the user activity is continually monitored. In one 
20 embodiment, if there are changes in user activity, the parameters for the prefetch 
function is reset in the Block 830. 
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